Hybrid Graph Neural Networks for Few-Shot Learning

نویسندگان

چکیده

Graph neural networks (GNNs) have been used to tackle the few-shot learning (FSL) problem and shown great potentials under transductive setting. However inductive setting, existing GNN based methods are less competitive. This is because they use an instance as a label propagation/classification module, which jointly meta-learned with feature embedding network. design problematic classifier needs adapt quickly new tasks while does not. To overcome this problem, in paper we propose novel hybrid (HGNN) model consisting of two GNNs, prototype GNN. Instead propagation, act adaptation modules for quick tasks. Importantly designed deal fundamental yet often neglected challenge FSL, that is, only handful shots per class, any would be sensitive badly sampled either outliers or can cause inter-class distribution overlapping. Extensive experiments show our HGNN obtains state-of-the-art on three FSL benchmarks. The code models available at https://github.com/TianyuanYu/HGNN.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Few-Shot Learning with Graph Neural Networks

We propose to study the problem of few-shot learning with the prism of inference on a partially observed graphical model, constructed from a collection of input images whose label can be either observed or not. By assimilating generic message-passing inference algorithms with their neural-network counterparts, we define a graph neural network architecture that generalizes several of the recentl...

متن کامل

Imitation networks: Few-shot learning of neural networks from scratch

In this paper, we propose imitation networks, a simple but effective method for training neural networks with a limited amount of training data. Our approach inherits the idea of knowledge distillation that transfers knowledge from a deep or wide reference model to a shallow or narrow target model. The proposed method employs this idea to mimic predictions of reference estimators that are much ...

متن کامل

Prototypical Networks for Few-shot Learning

A recent approach to few-shot classification called matching networks has demonstrated the benefits of coupling metric learning with a training procedure that mimics test. This approach relies on an attention scheme that forms a distribution over all points in the support set, scaling poorly with its size. We propose a more streamlined approach, prototypical networks, that learns a metric space...

متن کامل

Gaussian Prototypical Networks for Few-Shot Learning on Omniglot

We propose a novel architecture for k-shot classification on the Omniglot dataset. Building on prototypical networks, we extend their architecture to what we call Gaussian prototypical networks. Prototypical networks learn a map between images and embedding vectors, and use their clustering for classification. In our model, a part of the encoder output is interpreted as a confidence region esti...

متن کامل

Bayesian Neural Networks for K-Shot Learning

This thesis introduces multiple extensions and improvements to the probabilistic framework for k-shot image classification proposed by Bauer et al. [2017]. The aim of their framework is to transfer knowledge from a classifier trained on a large dataset to new classes with few training examples. We address three key considerations in this setting: the effectiveness of the weights-based concept t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2022

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v36i3.20226